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A Hitting Time Formula for the Discrete Green’s Function 


Andrew Beveridge* 


Abstract 

The discrete Green’s function (without boundary) G is a pseudo-inverse of the combina¬ 
torial Laplace operator of a graph G = (V,E). We reveal the intimate connection between 
Green’s function and the theory of exact stopping rules for random walks on graphs. We 
give an elementary formula for Green’s function in terms of state-to-state hitting times of 
the underlying graph. Namely, 

G(b 3) = Tj ( X 7 r k H(k,j) - H(i,j) 

Vfcev 

where 7q is the stationary distribution at vertex i and H(i,j) is the expected hitting time 
for a random walk starting from vertex i to first reach vertex j. This formula also holds for 
the digraph Laplace operator. 

The most important characteristics of a stopping rule are its exit frequencies, which are 
the expected number of exits of a given vertex before the rule halts the walk. We show 
that Green’s function is, in fact, a matrix of exit frequencies plus a rank one matrix. In 
the undirected case, we derive spectral formulas for Green’s function and for some mixing 
measures arising from stopping rules. Finally, we further explore the exit frequency matrix 
point-of-view, and discuss a natural generalization of Green’s function for any distribution 
r defined on the vertex set of the graph. 

AMS MSC 05C81 

1 Introduction 

Let G = (V,E) be a simple undirected graph on vertices V = {1,2, ... , n}. (For notational 
convenience, we identify a vertex with its label.) We define the volume of G to be vol(G) = 
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deg(fc). Let A be the adjacency matrix of G and let D = diag(deg(l),..., deg(n)) be the 
diagonal matrix of degrees. The discrete Laplace operator (cf. |8)) is the n x n matrix 

A = I-D~ 1 A. 

We can view A as a linear transformation A : V* —>• V* where V* denotes the vector space of all 
real functions on V. The Laplace operator is a variant of the graph Laplacian L = DA = D — A 
and the normalized graph Laplacian L = D 1 / 2 AD~ 1 / 2 = I — D -1 / 2 AD -1 / 2 . 

The Laplace operator is directly related to random walks on G. The matrix P = D~ l A is 
the transition matrix for a simple random walk on G since Pij = 1/ deg(z) when ij E E and 0 
otherwise. The matrices A = I — P and P share the same eigenvectors, where the eigenvalue 
Afc of A corresponds to the eigenvalue \' k = l — \k of P. The Laplace operator A has rank 
n — 1: the vector 7r = (7Ti,...,7r n ) where 7r* = deg(i)/vol(G) is a left eigenvector for eigenvalue 
Ao = 0, and the all-ones vector is a right eigenvector. With respect to P, these are eigenvectors 
for eigenvalue Aq = 1, with the following interpretations. Having 1 as a right eigenvector for 
Aq = 1 captures the fact that the transition probabilities from state i sum to one. Having 7r as 
a left eigenvector means that 7r is the stationary distribution for random walks on G. 

The discrete Green’s function G was introduced by Chung and Yau [9j. This n x n matrix 
is the pseudo-inverse of A given by 

GA = I-lvr T , 

(1) 

G1 = 0. 

The second constraint guarantees the uniqueness of G. Green’s function has been computed 
for some special families of graphs, including the path, the hypercube [9], products of cycles 
El, the complete graph and trees [20]. Many of these values have been computed via spectral 
formulas. Recently, Xu and Yau [20] developed a formula using two counting invariants of 
graphs that involve sums and products over spanning linear subgraphs of G. 

We give a very simple formula for Green’s function in terms of hitting times for random 
walks on G. This formula is more tractable and versatile than the results described above. Our 
formula also holds for weighted, directed graphs (or digraphs, for short), so we introduce some 
digraph definitions before stating our main theorem. 

Let G = (V. E, W) be a weighted digraph on vertices V = {1, 2, • • • , n}, directed edge set E 
and non-negative edge weights W = {w^j \ 1 < i,j < n}, where Wij = 0 whenever ij ^ E. The 
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corresponding transition probability matrix P has entries 


3 Yhk^V w ik 

This definition is a natural generalization of the undirected case: when G is an undirected graph 
whose edges have unit weight, this formula becomes P = D~ 1 A. For a strongly connected, ape¬ 
riodic digraph G, the Perron-Frobenius theorem guarantees that eigenvalue A = 1 has a unique 
unit left eigenvector it with n(i) > 0 for all i € V. This vector n is the stationary distribu¬ 
tion for the random walk corresponding transition matrix P. Li and Zhang m introduce the 
normalized digraph Laplacian C = II 1//2 (J — P)n~ 1//2 , where II is the diagonal matrix with 
= 7r(i). The corresponding digraph Laplace operator is A = I — P. As in the undirected 
case, Green’s function G is the matrix satisfying GA = I — \i r T and G1 = 0. 

From here forward, we assume that G = (V, E ) is a strongly connected digraph, where we 
break periodicity by considering a lazy random walk, if necessary. Given i,j E V, the hitting 
time H(i,j ) is the expected number of steps before a random walk started at i first reaches j. 
We choose to define H(i,i ) = 0 and let the return time Ret(i) denote the expected number of 
steps before a random walk started at i first returns to i. We also define 

H(n,j) = ^7 TiH(i,j) 
iev 

to be the expected number of steps it takes for a walk starting from a random initial vertex to 
reach j. We are now ready to state our main result. 

Theorem 1 Let G be a strongly connected digraph on vertices V = {1,2,... ,n}. Green’s 
function G for G is the n x n matrix given by 

G(i,j) = Trj(H(TT,j) - H(i,j)). (2) 

We give two proofs of this result. In Section O we give a proof for undirected graphs that uses 
two well known hitting time identities. This argument has the advantage of being short and 
self-contained. However, this proof does not shed much light on why this formula is correct. 

We remedy this situation in Section [3l where we give a second proof of Theorem [T] that 
places the result in a much richer context. This argument holds for strongly connected directed 
graphs. Formula @ is a manifestation of the deep connection between Green’s function and 
the theory of optimal stopping rules for random walks on G, introduced by Lovasz and Winkler 
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p-5 , I6j . Given a starting distribution o and a target distribution r, a stopping rule T(<r, r) 
halts a random walk whose initial vertex is drawn from a so that the final state is governed 
by t. In particular, we are naturally interested in optimal mixing rules T(*,7t) where o = i 
is a singleton distribution and ir is the stationary distribution. In Section [2 we review the 
basics about stopping rules on graphs. We then show that the matrix G is an expression of the 
vertex-wise characteristics of the family of optimal mixing rules {T(i, 7r)}i<j< n . In particular, 
we prove that G is a slight alteration of X n , the exit frequency matrix for n, introduced in 0. 

In Section QJ we use equation d^J) to calculate G for some families of undirected graphs. In 
Section [5] we develop spectral formulas for Green’s function and for the following three exact 
mixing measures. Let H(i,ir) denote the expected length of an optimal stopping rule from i to 
7r. The mixing time for a graph G is 

T m ix(G) = maxiL(z, 7r). 
i&V 

In other words, T m \^ (G) is the expected length of an optimal stopping rule to 7r when we start 
from the worst possible initial vertex. The reset time is the average mixing time: 

T reset (G) = ^7r ?; iL(i,7r). 
iev 

Finally, the hit time is the expected hitting time between two states drawn from the stationary 
distribution 

Thit{G) = ^ ^^kH{i,k) = ^2 ^kH(n,k). 
i,k&V k&V 

The random target identity [I] captures the very useful phenomenon 

y TTkH(i, k) = Thit(G) for all i € V. (3) 

k&V 

In our context, this means that the expected length of the naive rule “draw a target vertex k 
accord to distribution 7r, then perform a random walk until reaching k v is independent of the 
starting vertex. The relationships between T m ; x , T reset , it and other mixing measures of a 
graph are thoroughly explored in [2j. Our spectral formulas are most conveniently stated using 
the eigenvectors for the matrix L = D^^LD 1 / 2 = D~ 1 CD. 

Theorem 2 Let G be an undirected graph. Let 0 = Ao < Ai < • • • < \ n -\ be the eigenvalues 
for L = .D -1 / 2 LD 1 / 2 with corresponding orthonormal eigenvectors </>o, <j>i, ...,(j> n — i- Then we 
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have the following spectral formulas: 




T mix = max - 


de g(*) “ A fc 
vol(G) 


71—1 


^ ^ \ tfikif’ki'i 


r reset =-E\ 

iGV \ 
n—1 1 

Th “ ~ ^ Afc’ 


* GV y/ deg(i) deg(i') “ A fc 

deg(i) v- 1 1 - - 

,:'A A, Mki>, 


deg(z') ^ A fc 


fc=i 


where i' £ V is a vertex satisfying H(i',i ) = max Jg y 


(4) 

(5) 

( 6 ) 
(7) 


The spectral formula ([7]) for Thit is well known, but we include it here for comparison. Ellis mi 
gives an formula analogous to equation Q for the normalized Green’s function Q = D 1 / 2 GD~ 1 / 2 
in terms of the eigensystem for the normalized Laplacian C. 

Finally, in Section [6l we generalize Green’s function, based on the exit frequency matrix 
results in [3]. Green’s function is intimately related to optimal stopping rules from singleton 
distributions to the stationary distribution 7r. We can replace 7r with any distribution r to 
define a comparable matrix G T for that target distribution. We describe some duality results 
for these matrices that suggest some future research directions. 


2 Proof for undirected graphs via cycle reversing 

We give a direct proof of Theorem |Tj for an undirected graph G = (V, E) that uses some 
fundamental identities for hitting times on undirected graphs. These identities will be helpful 
when we calculate examples in Section [H First, we need the cycle reversing identity [10]: for 
all i,j, k £ V, we have 

H(i, j) + H(j, k ) + H(k, i) = H(j , *) + H(i, k ) + H(k, j). (8) 

We get another identity by multiplying equation © by 7T&, summing over 1 < k < n and using 
the random target identity Q: 

H(jr,i) + H(i, j) = H(ir,j)+H(j,i). (9) 
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( 10 ) 


Finally, it is well known that the return time to j satisfies 

t-. / 1 vol(G) 

Ret(j) = — = -—— . 

TTj deg(j) 

We can now give the first proof of our main result. 

Proof of Theorem [l] for an undirected graph: Define the n x n matrix B where Bij = 
TTj(H(TT, j) — H(i,j)). We show that B satisfies the constraint equations ([!]). This will confirm 
that G = B. We check the second condition first. We have 

B1 = Y^^(H(TT,j) - H{i,j )) = 'E« k '£« s H(k,j) = 0 

3 k j j 

by the random target identity 0). As for the first constraint, we have 

(BA) t j = (B- BD~ x A\i 

= - E 


= 7r 


j(H(n,j) - H(i,j)) - ^ 1 7r fc (ff(7r,fc) - H(i,k)) 

k~j 


1 


vol(G) 
1 


£(#(*, j) - k)) - - H(i, k)) 




k~j 


—— - h(j , k)) - - H(i, k)) 

' J \ k~j k~j 


i 


vol(G) 




k~j 


= ^Ti 


fe — 

\ deg i 


■deg yJ^’O-HW.O 


-TTj j / i 

7Tj(Ret(j) — 1) j = i 

-TTj j / i 
1 - TTj j = i 

where the fifth, sixth and ninth equalities follows from equations 0, 0 and ([TO]) , respectively. 
This entry wise formula is equivalent to our first constraint GA = I — l7r T . ■ 

We close this section by verifying that our formula is consistent with some facts established in 
[9] about Green’s function for an undirected graph. First, the matrix D 1 / 2 GD~ 1 / 2 is symmetric, 
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or equivalently: 7 TiG(i,j) = 7 TjG(j,i) for all i,j. Using our formula, indeed we have 

TTjG (i,j) = TriTTj(H(Tr,j) -H(i,j)) = TriTrj(H(Tr,i) - H(j,i)) = 7 TjG(j,i) (11) 

by equation (f9j) . Second, we have 

j) - ^^G(», j) = - G(i,j)). 

deg(j) deg(j) ttj 

Note that the equation above corrects a typo in the formulation (Theorem 8) in [9], where 
the coefficient for G(i,j) is written as vol (G)/ deg(i) rather than vol(G')/deg(j). (This typo 
originates with a variation of this minor error in their equation (23).) Using our equation for 
we have d-(G (j,j) - G(i,j)) = H(n,j) - (H(ir,j) - H(i,j )) = H(i,j). 


3 Proof for directed graphs via exit frequencies 

In this section, we give a second proof of Theorem [1] that reveals the connections between G 
and the theory of exact stopping rules for random walks on graphs. Our main contribution is in 
recognizing the deep relationship between these two lines of research. Once we have developed 
the proper context, our proof of Theorem [T] will be quite short. We start with an overview of 
the results in Lovasz and Winkler m- 

Let G be a digraph with transition matrix P, so that A = I — P. Given any starting 
distribution a and any target distribution r, there exist one or more stopping rules T : a —>• r 
that generate a sample from t when started from a vertex drawn from a. Such a rule T is 
optimal when it minimizes the expected length of the rule E(T) among all (a, r)-rules. The 
access time H ( a , r) is the expected length of an optimal (a, r)-rule, 

= min E(T). 
r \<r —vt 

For example, when a = i and r = j are singleton distributions, the access time equals the 
hitting time H(i,j). 

The key to understanding an access time is to partition this expected length by the vertices 
of the graph. Let T be an optimal (a, r)-rule. We define the fcth exit frequency Xk(a,r) to be 
the expected number of exits from vertex k when following rule T. The conservation equation 
pL8] states that for all j € V, 

^2pijXi(a,r) - Xj (a,r) = tj - aj. (12) 

i&V 
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Intuitively, this says that the expected difference between the number of entrances and exits 
at j must be Tj — <jj. All optimal (a, r)-rules have the same exit frequencies (even though the 
rules themselves may have very different execution). Moreover, we have the following simple 
test for optimality: 


T is an optimal stopping rule 3k € V, Xk(T) = 0. 

Such a vertex k with Xfc(cj, r) = 0 is called a ( a,r)-halting state. This simple criterion makes it 
easy to determine whether a stopping rule is optimal: we must simply check whether there is a 
vertex that is never exited. For example, when our target is a singleton r = j, the rule “walk 
until you reach j” is an optimal rule (since j is a halting state), so the access time from <r to j 
is H(a,j) = 52 i£V (TiH(i,j). 

For our final result from EE!, we have a formula for optimal exit frequencies in terms of 
access times: 

Xj(cr,T) = 7 T j(H( a i T ) + H ( T J) ~ 

In other words, the jth exit frequency measures the expected penalty for obtaining a sample 
from r along the way during a stopping rule from a to j. Herein, we focus on stopping rules 
that start from a singleton distribution a = i, in which case our formula is 

Xj(i,T) = 7 Tj(H(i,T) + H(j,j) (13) 

Next, we adopt the matrix viewpoint introduced in [4]. Fixing the target distribution r, we 
consider the family of stopping rules from singletons to r as an ensemble. We create an n x n 
matrix X T whose ith row contains the exit frequencies for an optimal (*, r)-stopping rule. This 
gives us the exit frequency matrix whose ijt\i entry is 

(X T )ij = Xj(i,r). 

We can then write the conservation equation (|12l) for this ensemble of optimal rules in matrix 
form: 

X r A = X T (I - P) = I - lr T . (14) 

We are now ready for the second proof of our main result. 

Proof of Theorem [[} Consider the exit frequency matrix X w . By equation (1141) . we have 
X„-A = I — l7r T . This is the first constraint of (H|) for Green’s function. Since A has rank n— 1, 


and 7r is a left eigenvector of A for eigenvalue 0, we have 

G = X n - hir T (15) 

where h is some constant vector. The second constraint in equation (JT]) requires that the rows 
of G all sum to zero. Meanwhile, the zth row of X ^ sums to H(i, ir): adding up all the expected 
exits gives the expected length of the rule. Therefore hi = so that the ij th entry of 

Green’s function is 


G(i,j) = Xj(i, 7 r) - TTjH(i,Tr) = Trj(H(Tr,j) - H(i,j)) 


by equation (fT3li with target distribution t 


= 7r. 


Equation (I15p reveals that Green’s function is the exit frequency matrix X n plus a rank one 
matrix. Further investigation of this exit frequency matrix can be found in [3]. We conclude 
this section with some immediate consequences of equation (|15D . In Section [6] we pursue some 
duality results for Green’s function, analogous to those found in [3]. 


First, we confirm that typically 7r,;G(z, j) ^ HjG{j. i) because the cycle reversing identity (|8j) 
does not hold for digraphs. Next, we give an alternative definition for the exit frequency matrix 
X n that parallels the Green’s function constraints ©• As noted above, every optimal stopping 
rule contains a halting state. Therefore X n is the unique matrix satisfying 


X n A = /-1tt t , 
min j £ v(X n )ij = 0 1 < i < n. 


(16) 


The second constraint for X n requires that all entries are nonnegative, and at least one entry 
in each row is zero. As noted above, this is equivalent to saying that the entries in the ith row 
are the exit frequencies for an optimal stopping rule from i to 7r. The second constraint © on 
G makes sense from a linear algebraic perspective, while the second constraint (1161) on X n is 
fundamental to the stopping rule point of view. 


Finally, we make some additional connections between Green’s function and the theory of 
stopping rules. First, it is clear that for all j £ V , we have 

= —G (j,j) 

and that Thit = Tr(G). The latter observation is also a manifestation of the spectral identity 
Thit = Ylk =1 1 /Afc listed in Theorem EJ Second, for every row i, we have 

X]G (i,j) = r). 

jev 
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Therefore we can obtain the reset time by taking the weighted sum of these row sums: 

Preset = EE 
iev jev 

Third, we can also recover the mixing time starting from i as follows: 

H(i,ir) = max-(17) 

j 7 Tj 

Equivalently, H(i, it) is the largest entry in the ith row of the matrix product —GII -1 where 
IT 1 = diag(7rj _1 ,7r^" 1 ,... In other words, 

H(i,n) = max — (GII _1 )y. 
j&v 

This brings us to our final observation: the mixing time T m j x is 

E m ix = max max — (Gn _1 )j,-. (18) 

i&v jaV 

In summary, these quantities are easily accessible, once we have Green’s function. This under¬ 
scores the deep connection between this pseudo-inverse of the Laplace operator and the theory 
of exact stopping rules. 

4 Examples 

In this section, we calculate Green’s function for some families of undirected graphs. The 
formulas for the complete bipartite graph and for general trees are new. The remaining formulas 
have previously been determined via different methods, as noted below. Our calculations are 
faster, and the connections to stopping rules provide new insight into many of these values. 
Before getting to the examples, we must recount some results from Lovasz and Winkler m 
about optimal mixing rules. That paper considers directed graphs, but we only present the 
simpler formulations for the undirected graph case. 

Halting states for an optimal rule T(i,7r) enjoy some additional structure. Given a target 
vertex i, another vertex j is called i-pessimal if it achieves H(j,i) = maxj, g v - H(k, i). We use %' 
to denote an i-pessimal vertex. (There may be multiple i-pessimal vertices; in this case we take 
i' to be an arbitrarily chosen one.) For an undirected graph, we have two different formulas for 
the mixing time: 

H(i,n) =H(i,i') -H(TT,i'). (19) 
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and 


H(i, 7 r) = H(if ,i) — H(n, i). 


( 20 ) 


Furthermore, i! is a halting state for an optimal (i, 7r)-stopping rule. A vertex z such that 
H ( z , 7 r) = T mix is called mixing pessimal. We have the following useful equivalence for a vertex 
z £ V on an undirected graph: 


Tmjy = H(z, 7r) 4=^- H(z ', z) = max H(i !, i). (21) 

For example, the endpoints of the path P n are both mixing pessimal. More generally, if z is 
mixing pessimal, then so is z'. meaning that H(z, 7r) = T m i x = H(z' , 7r). Moreover, z is a halting 
state for an optimal (z', 7r)-stopping rule. 

The Complete Graph. Green’s function for K n was calculated by Xu and Yau m- 
We use equation ((2j) to find these values. It is easy to verify that H(i,j) = n — 1 for all i / j. 
Therefore 

G(i,j) = TTj(H(Tr,j) -H(i,j)) = ^ • (n - 1) - = 

The Complete Bipartite Graph and the Star. Consider the complete bipartite 
graph iv r ,s where \U\ = r and \ W\ = s are the partite sets. A simple calculation shows that for 
Ui, Uj € U and Wk,W£ € W where i ^ j and k / £, 

H(ui,Wk) = 2s - 1, H(w k ,Ui) = 2r - 1, 

H(ui,uj) = 2r, H(w k ,we) = 2s. 

As for access times from the stationary distribution, we have 


n—l 

n 2 

2—1 2 


i + j, 

r i=> 


By equation we have 


H(n, u) 

— 2r — - 

— zi 2 , 

H (7T, w) = 2s — 

3 

2‘ 

have 




G (ui,Ui) = 

1 - A 

L 4 r’ 

G(w k ,u>k ) = 

1 - A 

1 4s 

O 

s 

£ 

II 

_3_ 

4 r ’ 

G (wk,wi) = 

3 

4s’ 

G(ui,w k ) = 

1 

4s’ 

G(wk,Ui) = 

4r ' 


In the special case of the star K\ n _[ with center c and leaves v, w are leaves, we have 

3 


G(c,c) = |, 

G ( C ’A> = -4FWTT’ 


G K U ) = i-ipWiy, 

G(u,c) = 

4(n_1) ’ G ( v ’ w ) = -iAry 

11 







The Green’s function values for K ln _i were also calculated in [20], 

The Path. Green’s function for the path P n was calculated in [7] using a formula for 
the normalized Green’s function for P n from [9]. We derive the same formula, and provide 
additional insight into its component terms. For 1 < i < j < n, we have 

G(i,j) = TTj(H(ir,j) - H(i,j )) 

= Kj((H(ir,j) - H(i,j)) + (H(l, n) - H(ir,n)) - {H(l,n) - H(n,n))) 

= 7Tj((i?(7r,j) - H(ir,n)) + (H(l,i) + H(j,n)) - T mix (P n )) 

= Kj((H(n,j) - H(j,n)) + (H(l,i) +H(j,n)) - T mix (P n )) 

= + H(n,j) - T mix (P n )), (22) 

where the third equality follows from equation (1191) and the fourth follows from equation (|9|) . 
The value of T m [ x (P n ) for the path was calculated in [5], and using this value we obtain 

in2 , .,9 2n 2 — 4n + 3 

G(», J) = Kj ( (* - !) + (n - j) -g- 

which matches the formula in [7j. Note that equation (|22[> tells a compelling story about what 
the value of G(i,j) captures about the graph. It sums the hitting times from the ends of the 
path to i and j, respectively, and then subtracts the mixing time. 

Trees. The path formula (1221) for Green’s function can be generalized to an arbitrary 
tree G. Let z and z' be vertices that achieve H(z\z) = maxj By equation (|2Tj) . we 

have H(z, i r) = T m j x = H(z', it). Let W = {z = w\,... ,Wk = z'} be the unique (z, z^-path in 
G. We now calculate G(i,j). Let i* = w r (resp. j* = w s ) be the vertex in W that is closest 
to i (resp. j). Without loss of generality, assume that r < s. Figure |T] shows an example. We 
manipulate G(i,j) as we did in the path example above to obtain 

—G(i,j) = TTj(H(TT,j) - H(i,j )) 

77 j 

= Kj (( H (t r, j) - H(i, j)) + (H(z, z') - H (tt, z')) - ( H(z, z') - H (vr, z'))) 

= Kj((H(ir,j) - H(ir,z')) + (. H(z,z') - H(i,j )) - T mix (G)) 

= - H(j, z')) + (H(z,z') - H(i,j )) - T mix (G)) 

= TT j ^(H(z',j*)-H(j,j*)) + ( H(z,i*)-H(iG*))-T mix (G )) 

where the last equality follows from expanding hitting times such as H(z',j ) = H(z',j*) + 
H(j*,j). In the case of the path, i* = i and j* = j while z = 1 and z' = n, which gives us 
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zm- 








•- *z' 


Figure 1: A tree G with mixing pessimal vertices z and z' where H(z',z ) = max„ e y H(v,z). 
The vertices i and j are such that the ( i , z)-path intersects the (z, z') path no further from z 
than the ( j , z )-path does. 


the path formula above. Further investigation of exact stopping rules on trees can be found in 

HUS IS]. 

The Cycle. Ellis m contains a formula for Green’s function on the cycle. We give a 
new derivation. We take our vertices to be {0,1,..., n — 1} and calculate the values for vertex 
0. It is well known (and easy to check) that H(0,j) = H(j, 0) = jin — j). Therefore 

' n 6 

j 

We then find that 

^ , 1 (in + l)(n- 1) , A 

= - i - 

The Hypercube. Let Qd be the d-dimensional hypercube, where the vertices are labeled 
by binary d-tuples v = (ui,u 2 , ■ ■ • ,Vd)- Green’s function for the hypercube was calculated in 
[9]. We provide a simpler formula, and make some further observations. 


We start by finding hitting time formulas to vertex 0, originally calculated by Pomerance 
and Winkler m- For 0 < £ < d, let 14 denote the kth level of Qd , consisting of all vertices 
labelled with k ones. Let denote the expected time for a random walk started at v € 14 to 
reach I4_i- Clearly, To = 0 and the remaining level-wise hitting times satisfy the recurrence 

Tk = 1 4--j—(24+1 + Tk), 1 < k < d. 

a 


It is easy to check that for 0 < k < d, we have 


E n fd\ 

j=k {j) 

±k ( d ~ i \ ■ 
\k-1) 

Therefore the hitting time from a vertex v € Vi to 0 is 

l l d , , 

ff(v,0) = 5> = £ 1 

k =1 k =1 \k-l) j=k 
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The hypercube has a transitive automorphism group, so H(tt, i ) = Yljev 71 0> *) = 

’51j€V 7r jH(i,j) = Thit- Equation (5.68) in Aldous and Fill [Tj states that 

d 


d \ - 1 (d 

J hit - ^2^ 


2 ^ k \k 

k =1 


Therefore, Green’s function for the hypercube is given by 


(23) 


G(0,v) = 


1 / d A 1 (d 


l .. d (d\ 

2 d l 2 ^ k\k ^ k 1 ^ (?) 

k =1 ' / k =1 j=k \k/ 


E 


- 


where v G V/. 

We conclude this section by calculating T m ^ (Qn) using formula (|20l) . Equation (5.69) in 
Aldous and Fill [1| gives an alternate formula for the pessimal hitting time: 

H(1,0) — 2 <i_1 2 Td^TT* 
k =0 V k ) 

We use induction to show that H( 1, 0) = ^ Ylt =l IT' This holds for d = 1, and we have 


1 


2 i E(«) 

fc=0 Vfci 


1 


d -1 


, = 2 

2 


1 


2+ EA + 


1 


= 2 d + 2 d 


= 2 d + 


fc^o ( fc ) (fc+i) 

d + 1 dA 2 fc d + 1 ^ 2 fc 
d ‘ 2 

fc=i 


_! (d + 1 ^4 1 
d ^ (V'l 


Y-. 


2 ^ k 

k =1 


Next, a straight-forward inductive argument shows that 



Combining this final expression with equation (1231) . we find that 

d ^ 1 1 

TmixiQd) = -2 d G(l, 0) = H{ 1, 0) - T hit = 2 E T ~ Y l ° g d ' 

Z k =1 K 


This result squares with the more traditional definitions of the (approximate) mixing time 
(cf. P]), which are known to be O(dlogd). It is worth remarking that both Thit and H( 1 , 0 ) 
are 0(2°* + 1/d + 0(l/d 2 )), while their difference is essentially ^dlogd. More generally, it 
is interesting to keep in mind that when a graph has a transitive automorphism group, the 
difference between H(i',i ) and Thit is, in fact, the mixing time T m i x . 
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5 Spectral formulas 


In this section, we explore Green’s function, hitting times, and exact mixing measures from the 
spectral point of view. We prove Theorem [2] and apply these results to the family of toric grids 
G/71 X C n2 X • • • X C nd - 


Let L = D 1 / 2 LD 1 / 2 = D 1 CD. The matrices L, L,£ all share the same eigenvalues 
0 = Ao < Ai < • • • < A n _i, though their eigenbases are different. Let ■ ■ ■ ,4> n -i be the 

corresponding orthonormal eigenbasis for the symmetric matrix L. We have L = / — N where 
N = D 1 / 2 AD 1 / 2 = D-^PD 1 / 2 , so we can reformulate Theorem 3.1 in m as 


H(i,j)=vo\ (G)£ 


'±(. 


k % 


(frki&kj 


—jAfc^degO') y/ deg(j) deg(i) 


(24) 


We use this spectral hitting time formula to hnd a corresponding formula for the access time 
from 7r to a singleton distribution, and then prove Theorem [2j 


Lemma 3 For j E V, we have 




V° 1 (G) y-\ fikj 

deg (j) “ A k ' 


(25) 


Proof: Using equation (1241) . we obtain 


i£V 


n— 1 


EE 

igv k =l 


1 

A k 


deg(j) kj 



V°1(G) y^ fikj 
deg(t) A k 


1 


n—1 

EyE 

fc=l Ak iev 



Vol(Cr) y-\ 4>kj 

deg O') fpy A k ' 


*Pkj 


The final equality holds because the vector v with components v t = y / deg(i)/deg(j) is an 
eigenvector of L for eigenvalue Aq = 0, and therefore v is orthogonal to (f>k for 1 < k < n — 1. 


Proof of Theorem [2} First we consider Green’s function. Equation (J4]) arises by substituting 
equations (1M1) and (f25l) into formula ([2]). Next, we give a spectral formula for H(i,ir). By 
equation (fT71) . we have H(i,ir) = max je y — d-G (i,j) = max je y(iL(i, j) — H(jr, j)). By equation 
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m, this maximum is achieved precisely when j is an i-pessimal vertex. In other words, 


= — 


vol(G) 1 , , 

- 2^ <j>ki<j>ki 


y / deg(i)deg(i / ) “ X k 

The formulas © and © for T m j x and T reset follow directly. 


As an application, we evaluate these spectral formulas for products of cycles. Ellis m gives 
an alternate, recursive formula for Green’s function on this graph family that uses Chebyshev 
polynomials. As a warm-up, we start with the cycle C n , whose calculation also appears in 
[1TJ. Let e = e 2m l n . The eigenvalues of L are Ao, Ai,..., A n _i where A*, = 1 — ^(e fc + e ~ k ) = 
1 — cos(27rA;/n) with corresponding eigenvector whose ith component is </>&(*) = e kl / ^/n. 
Therefore, Green’s function for C n is given by 

G(o 7 ) = - V ekJ = - V cos ( 27rfc j/ ra ) 

n 1 — cos(27r k/n) n ^ 1 — cos(2nk/n ) 


Of course, we also have G(0,j) = ^ ((n + 1 )(n — l)/6 — j(n — j)), as discussed in Section[4j 


We now consider the product of cycles C ni x C n2 x ... x C Ud . using x = (x±,X 2 , ■ ■ ■, Xd) to 
denote a vertex. We will label the eigensystem using an analogous toric notation A r = X rir2 ... rd . 
The eigenvalues for this Cartesian product can be calculated using Exercise 11.7 in m- Let 
€j = e‘ 2m / nj for 1 < j < d, and let r = (ri, V 2 ,..., r<j) where 0 < rj < n* and 1 < i < d. The 
eigenvalues are 


A r 



A corresponding orthonormal eigenbasis for L consists of the vectors (t> rir2 — rd given by 


4 > rir2---r d (jl i 32 ; • • • ,jd) 



riji 


J2h 

e 2 


gS d 3 d 

€ d 


where n = n\n 2 ■ ■ ■ rid- By the symmetry of this toric grid, it is sufficient to calculate Green’s 
function when the first vertex is 0 = (0,0,..., 0). We have 


G(0,j) 


1 

n 


y 


rm T2J2 
e l e 2 


i - rf ' 1 Eti 


J^kJd 

“ ‘ 6 k _ 

cos(27 xrt/nt) 


1 cos (2vr Eti 

n rjto 1 - d~ l J2t =1 cos(2vr r t /n t ) 



Symmetry also tells us that H( 7r,0) = = Thit- So we have 

1 




n A r 

r^O r^O 


1 - d 1 Et= 1 cos(27rr t /n t ) 
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Since this toric grid has a transitive automorphism group, we have T mix = T reset . The vertex 
(|"ni~|, |~n 2 ~|, • • •, | rik\) is a O-pessimal vertex, so that 



In particular, this formula holds for the hypercube Qd (where each component is actually the 
path P 2 ). Simplifying yields the hypercube formulas as found in Section |4l We leave these 
calculations to the interested reader. 

6 A Generalized Green’s Function 

Exit frequency matrices X T (for general target distributions r) provide great insight into the 
theory of exact stopping rules. For example, exit frequency matrices lead to natural proofs of two 
non-trivial time reversal identities for exact mixing measures T m ; x = T m ; x and T rese t = 7f orget , 
where the reverse forget time Tf orget is defined below j3j. In this final section, we define a 
generalized Green’s function G r for a given target distribution r, and we explore some duality 
results corresponding to time reversal of random walks. 

In Section [3l we showed that Green’s function is the exit frequency matrix X n altered so 
that the row sums are zero. In other words, we can think of G as a signed exit frequency 
matrix (where “negative exit frequencies” are allowed). From this vantage point, we define the 
generalized Green’s function G T be the n x n matrix with entries 


G r (i,j) = Xj(i,T) - 7 TjH(i,T) = 7 Tj(H(T,j) - H(i,j )) = TTj 


*> T ) = Kj(H(T,j) - H(i,j )) = 7 Tj( ^ ~^T k H(k,j) - H(i,j) 


More compactly, G r = X T 
this matrix satisfies 


x k ' 

h7r T where hi = H(i,r). Generalizing the discussion in Section [3j 


G r A = 1- 1 T r, 
G r l = 0. 


For example, when the target is the singleton distribution r = k, we have 


Gfc(b j) = nj(H(k,j) - H(i,j)). 


The kth. row of G& is all-zero, while the fcth column satisfies G^(i. k ) = — 7 TiH(i, k). 
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Naturally, we are interested in finding Green’s function other useful target distributions. 
Here, we discuss a pair of target distributions that are important for stopping rules: the reverse 
forget distribution and the n-core distribution. These distributions are related to the stationary 
distribution, and they enjoy a duality relationship, as described below. 

For full generality, we consider the weighted digraph case, and we will talk about “the 
Markov chain P' rather than “the random walk on weighted digraph G with transition matrix 
P.” The Markov chain P has a corresponding dual chain 

P = n - 1 p T n. 

Time reversal converts random walks governed by P into random walks governed by P. We 
continue to employ hatted notation to indicate quantities associated with the reverse chain P. 
For example, H(i,j) is the expected length of a random walk from i to j on the reverse chain, 
and X n is the exit frequency matrix for optimal mixing rules on the reverse chain. 

Next, we introduce another mixing measure. The forget time is defined as 

Target = minmaxF(j,T). 

Lovasz and Winkler [l7j proved the remarkable equality T reset = Tf orget and that the reverse 
forget time is achieved uniquely by the distribution fi where 

fii = TTj ( 1 + ^2 PijH(j, 7 r) - H(i, 7r) 

' jev 

The duality between 7r (on the forward chain) and fi (on the reverse chain) was placed in a 
broader framework in [1] via exit frequency matrices. The connection is summarized by the 
matrix equation 

Xjx = n _1 (X 7r — lb T ) T n where = minxj(i, tt). 

The reverse forget distribution fi is also called the tt- contrast distribution i r*. The 7r-core 7r** is 
the distribution whose (forward) exit frequency matrix is 

W,*. = X n - lb T . 

The 7r-core n** is fully dual to fi = n*: their exit frequency matrices satisfy 

X tl = U^X^M. (26) 
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Furthermore, the formula for 7r** mirrors that of the forget distribution /}: 

<* = n i f 1 + Y A) - H (j, /j) 

V jev 

We now calculate Green’s function for £i = ir* and 7 r** for the reverse chain and forward 
chain, respectively. The Green’s functions for these distributions exhibit some nice duality 
properties. First, we consider jl on the reverse chain: 


We can use equation (1261) to get an alternative formula: 

j) = - TTj Y Xk(i, A) = - 7 Tj ^ ^Xj(k,lT**) 

keV 1 k£V 

= 7 Tj (h(J, 7 r**) + - H(j, i) - Y 7r k(H(k, ir**) + H(ir**,i) - H(k , i))\ 

' k&v ' 

= 7T J YiF(7r,z) - H(j,i) + - Y n k H(k, tt**)X\. 

' ' kev ' ' 

= ^G (j,i) + 7 Tj (h(J, tt**) - Y • 


kev 


(27) 


In fact, the 7r-core has the nice property that H(i, 7r) = H(i, tt**) + H(tt**,tt) for all i G V (see 
0), so we also have 


V(A j) = ^G(j, l) + TTj ( H(j , vr) - T rese t ) • 


This equality is reminiscent of the symmetry of equation (1111) in the undirected case. 
A similar argument for 7r** on the forward chain P gives 


Gtt = TTj(H(TT**,j) - H(i,j )) 

= tTjYgXttT) - H(j,i) + (H(j, fi) - Y KkH{k,p,) 

' ' kev 

= —G (j,i) +Tr j (H(j,p 1 ) - Y 7T kH(k,fj,)\ (28) 

' K% ' kev ' 

Equations (1271) and (1281) relate these matrices to the standard Green’s functions on the forward 
and reverse chains. We make two observations. First, the quantities on the right hand side 
concern the dual chain, and the roles of i and j reversed. Second, the right hand side contains 
a correction term that compares the length of rules to the dual distribution. These types of 
duality relationships are characteristic for stopping rules on the forward and reverse chains. We 
believe that this point of view will be useful in exploring further properties of Green’s function. 
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